Checking for optimal solutions in some iVP-complete problems 
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For some weighted jVP-complete problems, checking whether a proposed solution is optimal is a 
non-trivial task. Such is the case for the celebrated traveling salesman problem, or the spin-glass 
problem in 3 dimensions. In this letter, we consider the weighted tripartite matching problem, a well 
known ./VP-complete problem. We write mean-field finite temperature equations for this model, and 
show that they become exact at zero temperature. As a consequence, given a possible solution, we 
propose an algorithm which allows to check in a polynomial time if the solution is indeed optimal. 
This algorithm is generalized to a class of variants of the multiple traveling salesmen problem. 

PACS numbers: 75.10.Nr, 75.40.-s, 75.40. Mg 



A combinatorial optimization problem is defined as the 
minimization of a cost function over a discrete set of 
configurations Typically, in statistical physics, find- 
ing the ground state of an Ising spin-glass (Ising model 
with random interactions) is a combinatorial optimiza- 
tion problem, where the cost function is the magnetic 
energy of the system. The size N of an optimization 
problem is the number of degrees of freedom of the sys- 
tem over which the minimization is performed. In a spin- 
glass problem, the size N is just the number of spins. In 
the following, we shall be interested only in problems 
for which the cost function can be calculated in a time 
which is polynomial in the size N. This very wide class of 
problems is called the NP class. Many physical problems 
belong to this class. 

An optimisation problem Q is said to be ./VP-complete 
if it is in NP, and if all problems in NP can be shown to 
be polynomially algorithmically reducible to Q. There- 
fore, A^P-complete problems are in some sense the most 
difficult NP problems. All iVP-complete problems are 
algorithmically polynomially equivalent. The archetype 
of such problems is the celebrated traveling salesman 
problem (TSP): Given N cities, find the shortest path 
going through each city once and only once. Although 
many algorithms exist which provide exact solutions for 
small enough TV or almost optimal solutions for larger 
N, there is no known algorithm which provides the exact 
shortest path in a polynomial time. This is due to the 
combinatorial complexity of the paths, and to the strong 
non-convexity of the cost function in phase space, which 
manifests itself by an exponentially large number of local 
minima. 

As stated above, any combinatorial optimization prob- 
lem which is algorithmically equivalent to the TSP is 
iVP-complete. Famous examples of such problems in- 
clude the spin-glass (SG) problem in dimension d > 3 
0, the Hamiltonian path (HP) problem (given a graph, 
find a path which goes through each points of the graph 
once and only once), the weighted tripartite matching 
problem (TMP), 3-satisfiability, etc. For an extensive 
list of ./VP-complete problems, see ref. Q. 

In the spin-glass problem, physicists and computer sci- 
entists have developed algorithms which allow to com- 



pute the exact ground state for small enough systems 
The analysis of these exact ground states and low- 
lying excited states allows to check the validity of various 
spin-glass theories Q. 

If there is a polynomial time algorithm to solve a com- 
binatorial optimization problem, the problem is said to 
belong to the P-class. Many problems belong to P, 
among which the assignment problem (also known as the 
weighted bipartite matching problem denoted BMP), the 
spin-glass problem in d — 2, etc. Of course the P class 
is included in the NP class, but it is not known if the 
inclusion is strict. This is the celebrated "Is P = NP ?" 
problem. 

The strong analogy between combinatorial optimiza- 
tion problems and the physics of disordered systems was 
recognized in the early 1980s 0], and was the basis of 
the development of simulated annealing techniques in op- 
timization. At finite temperatures, many of these opti- 
mization problems exhibit glassy behaviour as seen in 
disordered systems H H El El Q • 

As mentioned above, when going to larger sizes, find- 
ing exact ground states of A^P-complete problems be- 
comes impossible, and one resorts to non-deterministic 
methods like Monte Carlo algorithms or Markov chains. 
These methods provide candidates for solutions to the 
optimization problem. In some cases, checking that one 
has a true solution of the optimization problem is an easy 
task. For instance, in the HP problem, given a path, it is 
easy to check whether this path is Hamiltonian and thus 
solves the problem. In many weighted problems however, 
checking that one has a solution is a very non trivial task. 
Such is the case for example in the TSP problem. Given 
a tour, there is no known algorithm to determine whether 
it is the optimal path, except by actually computing the 
optimal path. Similarly, given a set of coupling Jjj and 
a spin configuration Si, there is no known algorithm to 
check that this configuration is the ground state of the 
spin-glass, except by computing its actual ground state. 

In the present paper, we study the weighted multi- 
partite matching problem. To simplify, we specialize to 
the tripartite case. Before defining it, we first recall the 
assignment problem or BMP (also called the wedding 
problem). Assume we have two sets {i = 1, ...,7V} and 
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{j = 1, ...,iV}. A positive pairing cost Uj is assigned to 
each matching of i and j. Note that the matrix kj has 
no reason to be taken symmetric. A matching of the two 
sets is in fact a permutation P of the set {j} and the 
corresponding cost is 

N 

L = Y,kp(i) (1) 

i=l 

Solving the BMP amounts to finding the permutation 
P which minimizes i.e. the complete pairing of {i} 
and {j} which has lowest cost. 

The simplest case of multipartite matching problem is 
the tripartite one. The TMP involves three sets {i — 
1, TV} , {j — 1, N} , {k = 1, N} and a positive 
cost function Ujk ■ A matching of the 3 sets is defined by 
a permutation P of the set {j} and a permutation Q of 
the set {k} with cost 

N 

L = ^ hp(i)Q(i) (2) 

i=l 

Solving the TMP amounts to finding the permutations 
P and Q which minimize <|2j|. Generalization to mul- 
tipartite matchings is straightforward. As mentioned 
above, the bipartite version is polynomial, whereas the 
tri-, quadri-, etc. matching are iVP-complete. Note that 
in the BMP, the number of possible configurations is Nl 
whereas it is (AM) 2 in the TMP. The phase diagram of 
these multipartite matching problems has been studied 
recently for sets of random independent costs [I33 |. 

In this article, we first formulate the finite temperature 
TMP as an integral over complex fields. The saddle-point 
equations are derived and are shown to provide the exact 
solution to the TMP at zero temperature. Unfortunately, 
this does not help in solving the problem. However, from 
these equations, we find that given a tripartite assign- 
ment, one can check whether it is the absolute minimum 
of the cost function in a polynomial time. This method 
can easily be applied to a whole class of multiple traveling 
salesmen problems [1J|. This of course does not violate 
the A^F-complete character of these problems. We are 
not aware of any other weighted A^P-complete problems 
which could be checked in a polynomial time, and hope- 
fully this method could be generalized to other problems. 

It is possible to give an integral formulation of the 
TMP using techniques similar to those used for the BMP 
0, Q . We want to calculate the partition function Z of 
the TMP at temperature T. Denoting by ks the Boltz- 
mann constant and — 1/fcsT , we have 



z = exp -P^ l iPV)Q(i) J ( 3 ) 

p,QeS N \ i=i / 

where Sn denotes the group of permutations of N objects 
(symmetric group). We define 



Uijk = exp (-flkjk) 




dxjdx* 

TT TT TT 



x exp (- Y + ip^* + XiX*j) 

(N \ N 

Yl UiMjXk II (titiXi) (4) 
i,j,k—l J i—1 

Let us show that this is an exact expression for the 
partition function of the TMP. We use Wick's theorem. 
We first note that the contraction of each field with its 
conjugate is just equal to 1. Expanding the exponential 
in powers of Uijk, we should contract each ipiiXi with 
its conjugate (j)*,ip*,Xi- Since the integrand is linear in 
each <fi*,ipi,xt) the expansion in powers of Uijk should 
be limited to first order. This obviously proves equation 
©■ 

A similar formula can easily be obtained for the BMP, 
involving only two kinds of fields instead of three. 

A standard way to approximate eq. <@J is to perform a 
saddle-point expansion. The saddle-point equations read 




N 

<f>* = Y U ijktpjXk 

and similar equations for the other variables. Eliminating 
the conjugate variables, we have the 37V equations 

N 

1 = <t>i Y UW&jXk ( 5 ) 

for any i and the analogous equations for the other vari- 
ables. 

There are 3./V saddle-point equations for the 3A^ vari- 
ables (p^tp^Xi- These equations are complicated non- 
linear equations and can be solved numerically. They dif- 
fer from those obtained from the cavity method [lfl. tl^|. 
However, they display some interesting properties in the 
zero temperature limit. Introducing new variables 

one can see that solving equations (JjJ in the zero temper- 
ature limit amounts to finding two permutations P and 
Q such that 

cti + fop(i) + cg(j) = hp(i)Q(i) (6) 
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for any i , and 

di + bj + c k < lij k (7) 

for any triplet [i,j,k) ^ (i, P(i),Q(i)) . The total cost 
of the matching is 

JV N 

L = ^ hp{i)Q{i) = / , K + h + Ci) (8) 

i=l i=l 

We now proceed to prove that these equations are ex- 
act, i.e. their solutions (if they exist) provide the optimal 
tripartite matching. We first note that if we have two sets 
of solutions (a, 6, c) and (a', 6', c') which satisfy equations 
© and Q with the same P and Q, they necessarily have 
the same total cost, due to equations (HI- Now consider 
another pair of permutations P' and Q' . The total cost 
L' associated to these permutations is 

N 
i=l 

According to eq. 

a* + frp'(i) + c Q'(i) < kp'(i)Q'{i) 

and therefore, summing over i implies 
L < L' 

Therefore, any matching other than (P, Q) have larger 
cost, which proves that (P, Q) generates the optimal 
matching. 

A formulation similar to © and {JJ has been known 
for the BMP, with only two sets of variables a and b. It 
can be shown that these equations can be solved using 
the so-called Hungarian method which is an 0(A 3 ) 
algorithm. 

In the case of the TMP, these equations unfortunately 
cannot be solved in a polynomial time. However, as we 
shall now see, they allow to check in a polynomial time 
whether a proposed solution is the actual optimal match- 
ing. 

Let us consider the reciprocal problem: Assume we 
are given a matching. How can we check whether it is 
optimal? 

The matching is defined by a set of A'' costs {hp{i)Q{i)} ■ 
If this set is optimal, then there exists a set of 3A 
variables a,i,bi, a such that the constraints © and 
would be satisfied. 

These are a set of A equations and A 3 — A linear in- 
equalities for 3 A variables. We can simplify further by 
using equations (jSJ , and obtain a set of A 3 — A inequal- 
ities for the 2A variables a« and bi 

a i + - OQ-i(fc) - i>PQ-i(fc) <U]k-lQ-^{k)PQ- 1 {k)k (9) 

This set of linear inequalities with integer coefficients 
belongs to the well known class of optimization problems 



called "linear inequalities" jjj. This problem, which is 
related to linear programming, is known to be solvable in 
a time which is polynomial in the size 2 A of the problem 
fl^.ll7]|. Therefore, we can find, in a polynomial time, i) 
either that there is a solution to Q, in which case the 
proposed solution is the optimal solution to the TMP, ii) 
or that there is no solution to these inequalities, in which 
case the proposed solution is not the optimal one. 

We have not found a general proof of existence of the 
a,-, bi, Ci for the optimal solution. 

Let us show how this method can be generalized to 
some variants of the multiple traveling salesmen problem 
(MTSP). The MTSP is similar to the TSP, except that 
the number of travelers in not equal to one. Consider 
a set of A points (in an abstract space) with positive 
distances Uj . We consider the TMP in which 

h,j,k — + hk) 
if k) are distinct 

if 2 indices are equal. 

With this choice, a finite cost tripartite assignment can 
be viewed as a set of loops visiting each point once and 
only once. The corresponding TMP thus amounts to a 
MTSP, with any number of salesmen, each visiting at 
least 3 cities. If we are presented with a possible opti- 
mal path, say {Z12, Z23, — , Ini}, we look for two sets of 
variables ai and a which satisfy the linear inequalities: 

a% + Ck — dj-i — Cj + i < -(Zjj + Ijk — lj-x,j — lj,j+i) 

Again, although the problem is AP-complete, check- 
ing the optimality of the solution can be achieved in a 
polynomial time. The whole method can be easily gen- 
eralized to MTSP with loop sizes greater than p in terms 
of p-partite weighted matching problems, to find criteria 
of optimality which are polynomial. 

We have proposed an integral representation of the 
TMP, from which we derive some mean-field equations. 
These equations turn out to be exact at zero tempera- 
ture, and could have in fact been derived directly with- 
out going through the mean-field method. However, we 
find this approach interesting, as it might be generalized 
to other AP-complete problems. The zero temperature 
equations cannot be solved in a polynomial time. How- 
ever, given a test solution to the problem, they allow to 
check in a polynomial time whether the proposed solu- 
tion is indeed the optimum of problem. This situation is 
quite unique in AP-complete problems, since in princi- 
ple, for such problems, the existence of an exponentially 
large number of local minima prevents checking the op- 
timality in a polynomial time. A generalization of this 
method to the TSP or to the spin-glass problem would 
be of great interest for the physics of disordered systems 
and is currently under investigation. 
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